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A METHOD AND SYSTEM OF FILTERING A RED-EYE PHENOMENON FROM A 
DIGITAL IMAGE 

BACKGROUND 

5 

1. Field of the Invention 

The present invention relates generally to digital photogi \ ■ flask and 
specifically to filtering "Red Eye" artifacts from digital images shot by digital cameras, scanned 
by a digital scanner, or otherwise acquired by a digital image acquisition device. 

10 

2. Description of the Related Art 

i. Red Eye Phenomenon 

"Red-eye" is a phenomenon in flash photography where a flash is reflected within a 
subject's eye and appears in a photograph as a red dot where die black pupil of the subject's eye 

1 5 would normally appear. The unnatural glowing red of ait eye is due to internal reflections from 
the vascular membrane behind the retina, which is rich in blood vessels. This objectionable 
phenomenon is well understood to be caused in part by a small angle between the flash of the 
camera and the lens of the camera. This angle has decreased with the miniaturization of cameras 
with integral • pa nlities. Additional contributors include the relative closeness of the 

20 subject to the camera, iris color where fight eyes are more susceptible to this artifact and low 
ambient light levels which means the pupils are dilated. 

The red-eye phenomenon can be somewhat minimized by causing the Ms to reduce the 
opening of the pupil. This is typically done with a "pre-fiash", a Hash or illumination of light 
shortly before a flash photograph is taken or a strong additional light source. Tins causes the iris 

25 to close. Unfortunately, these techniques typically delay the photographic exposure process by 
0,5 second or more to allow for the pupil to contract. Such delay may cause the user to move, the 
subject to turn away, etc. Therefore, these techniques, although somewhat useful in removing the 
red-eye artifact, can cause new unwanted results. 
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ii Digital Cameras and Red Eye Artifacts 

Digital cameras are becoming more popular and smaller in size, and produce digital 
images each comprising a plurality of pixels indicative of colour, the pixels forming various 
5 shapes thin tl sage hgital came s have several advan iges < J c T >iua-> eg 

elirmnn (. iptured and stored in a memory array for 

display on a display screen on the camera itself. This allows photographs to be viewed and 
enjoyed virtually instantaneously as opposed to waiting for film processing. Furthermore, the 
digitally captured image may be downloaded to another display device such as a personal 

10 computer or color printer for further enhanced viewing, Digital cameras include microprocessors 
for image processing and compression and camera systems control Nevertheless, without a pie- 
flash, both digital and film cameras can capture the red-eye phenomenon as the flash reflects 
within a subject's eye. Thus, what is desired is a method of eliminating red-eye phenomenon 
within a miniature digital camera having a flash without the distraction of a pre-rlash. 

1 5 An advantage of digital capture devices is that the image file contains more data than 

pure image (pixel) data. Such additional (.lata is also referred to as meta-data and is usually saved 
in tire header of die digital file containing the image. The meta-data may include (a) information 
about the camera or other acquisition device which is independent of the particular image being 
acquired at any given time (device-specific meta-data) and (b) the acquisition parameters for a 

20 particular image being acquired (acquisition-specific meta-data), i.e. information relating to 
those parameters that are adjustable or that may change from exposure to exposure, based on 
user input or omerwise. 

ill. Digi tal Scanning and Red Eye Artifacts 
25 In many cases images that originate from analog devices like film are scanned to create a 

digital image. The scanning can be either for the purpose of digitization of film-based images 
into digital form, or as an intermediate step as part of the printing of film based images on a 
digital system. Red Eye phenomenon is a well known problem even for film cameras, and in 
particular point and shoot cameras where the proxhnity of the flash and fee lens is accentuated. 
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When an image is scanned from film, the scanner may have the option to adjust its scanning 
parameters in order to accommodate for exposure and color balance. In. addition, for negative 
film the i l f iu will revei e the colore as well as remove th 01 In base mask 

of the negati ve. 

5 - e J f l Mi ) 3 enerall re ! nit ha o i.gna i m 

Howex, er. most films include infon nation about the manufacturer, the film type and even the 
batch number of the emulsion. Such, information can be useful in evaluating the raw, uncorrected 
color of eyes suffering from red eye artifacts. 

3.0 iv. Anthropometry 

Anthropometry is defined as the study of hitman body measurement for use in 
j I og < s ition and comparison Such data, albeit extremely statistical in nature, 
can provide good indication as to whether an object is an eye, based on analysis of other detected 
human objects in the image. 

15 

v. Red-Eye Detection And Correction Algorithms 

Red-eye detection algorithms typically include detecting the pupil and detecting the eye. 
Both of these operations may be performed in order to determine if red-eye data is red-eye or if 
an eye has red-eye artifact in it. The success of a red eye detection algorithm is generally 

20 dependent on the success of a correct positive detection and a minimal false detection of the two. 
In the prior art red-eye detection is usually done primarily on image (pixel) data, as 
described, for example, In U.S. Patent 6,407,777 (DeLuca). Although DeLuca does use some 
meta-data, it is of an elementary nature and solely acquisition-specific (flash on/off, ambient 
lighting level, camera-subject distance), it is derived solely to determine whether the image 

25 acquisition conditions were conducive to red-eye and hence whether in fact to use red-eye 
correction at all. 

US 2003/0095 1 97 (Eastman Kodak) discloses the use of meta-data in the correction of 
several image defects, including red-eye. However, tike DeLuca, Eastman Kodak only uses the 
meta-data to make a decision as to whether red-eye is likely to have occurred, but does not use 
3 0 such data in the correction process itself. 
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Meia-dat; I eenused in the phott , dusrr> where a digital image may 

be post-processed to optimize the output, from a printing system. Examples of this use of meta- 
data are provided in U.S. Patents 6,505,003 6,501,91 1 and 6,496,655. Meta-data may also be 
recorded onto a standard camera film and the meta-data may be subsequently recovered to assist 
5 in the post-processing of the fi Im, tj S Patent 6,429,924. 

SUMMARY OF THE INVENTION 

The present invention provides a method of filtering a red-eye phenomenon from a digital 
10 image, the methoi > pi i using both anfhropometric data and meta-data associated with the 
image to identii - ions of the image potent diy s eeptible to red-eye artifacts. 

In the preferred embodiment the image is created by optically projecting an external 
subject onto a sensor array through a lens, and properties of said regions are identified as a 
1 5 function of one or more of the focal length of the lens, the aperture of the lens, the size of the 
array, the resolution of the array, the distance to the subject and the depth of field at the moment 
of acquisition. 

The invention also provides a system of filtering a red-eye phenomenon from a digital 
20 image, the system comprising means using both anthropometric data and meta-data associated 
with the image to identify regions of the image potentially susceptible to red-eye artifacts. 

BRIEF DESCRIPTION OF THE DRAWINGS 



2 5 Figure 1 shows a block diagram of a digital image acquisition device operating in 

accordance with a preferred embodiment. 

Figure 2 illustrates a high level workflow of a method of detecting red eye artifacts in digital 
images in accordance with a preferred embodiment 

Figures 3a-3d schematical ly depicts a light sensor, and the formation of a digital pkelated 
30 image on it, for use in explaining the preferred embodiment. 
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Figure 4 describes a high level process of using metadata as part of red-eye detection in 
accordance with a preferred embodiment 

Figure 5 illustrates by means of geometric optics, a relationship between an object and an 
image based on a distance to the object and the focal length, where tire local length is the distance 
5 from the image principal plane of the optical system to the image focal plane, which is the plane 
where, the image of the object situated at infinity is formed. 

Figure 6 ill ustrates a relationship between focal length of a lens and depth of field, and an 
object size as it appears on an image. 

Figures 7a-7e illustrate some anthropometric measurements of a human face for an adult 
10 male and female. 

Figure 8 is a workflow diagram describing a statistical analysis of an image using meta-dala 
and anthropometric data in accordance with a preferred embodiment. 

Figure 9 depicts a spectral .response of an acquisition system based on spectral sensitivity 
curves of a hypothetical three color sensor, the spectral distribution of a generic light source and the 
1 5 spectral characteristics of a object being photographed. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The methods of the preferred embodiments are generally applicable to digital image 
20 acquisition devices, such as digital cameras and scanners, and to and output devices such as 
printers and - ri storage devices. When the terms digital camera and output device or 
printer are used, it is generally meant to more broadly, respectively include digital image 
acquisition devices and digital data output devices. 

The digital camera or other acquisition device preferably has the capability of analyzing 
25 and processing images. Alternatively, the processing of the images can be done outside of the 
camera on a general purpose or specialized computer after downloading the images or on a 
device that is acting as a hosting platform for the digital camera. Sneh a device may be, but. is not 
limited to, a hand held PC, a print server, a printer with built in processing capability, or cell 
phone equipped with a digital camera. Alternatively the acquisition process can be of an analog 
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image, such as scanning of a film based negative or reversal film, or scanning of a photographic 
print. 

The accuracy of a detection, process may be measured by two parameters. The former is 
the correct detection, which relates to the percentage of objects correctly detected. The second 
5 jararneterfo s be amount of mis- unifications, which is also 

defined us I - le c lions or beta-error. False detections relate to the objects falsely determined 
to have the specific characteristics, which they do not possess. 

Overall the goal of a successful detection process is to improve the accuracy of correct 
detections while minimizing the percentage of false detections, m many cases there is a tradeoff 

10 between the two. When the search criterion is relaxed, more images are detected hut at the same 
time, more false detections are typically introduced, and vice versa. 

In order to i mprove the accuracy of the red eye detection and correction, the preferred 
embodiment uses anthropometric information about the subject and meta-data, the latter 
comprising device-specific meta-data and acquisition-specific meta-data as previously described, 

15 In the case of a li $ »J ~ mera, device-specific meta-data may include color sensitivity, spectral 
response or size oi heca e >i s> lether the sensor is CCD or CMOS, tone reproduction 
transformations of the image and color transformations from the RAW data gathered by the 
sensor, e.g. CCD, to a known color space such as RGB. the f-sfop, or other camera-specific 
parameters understood by those skilled in the art, and combinations thereof. In the case of 

20 scanning device-specific meta-data may include the color sensitivity curve of the film, the color 
sensitivity of the scanner sensor, whether CCD or CMOS, whether linear or area sensors, the 
color transformations from the RAW data gathered by the scanner to a known color space such 
as RGB. Acquisition meta-data may include focal distance as determined by an auto focus 
mechanism of a digital camera, the power of the flash including whether a flash was used at all. 

25 the focal length of the lens at the moment of acquisition, the size of the CCD, the depth of field 
or the lens aperture, exposure duration, or other acquisition parameters understood by those 
skilled in the art, and combinations thereof. Anthropometric data may include first and higher 
order statistics, which is an average and a variability of an expected size and ratio between 
different parts of the human body, and particularly the facial region. 
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Using the i ted infomiaiion, preferred embodiments described herein achieve a 

more accurate detection of eye regions potentially containing red eye artifacts. Based on this 
detection, a processor, whether in a camera or in a different device, can perform a correction 
step. 

5 Referring to Figure 1 block 1 00 represents an in t t c << 1 >s c ic tich can be a 

digital camera in \ arious p kagii m h as a digital still camera, a lens connected to a hand held 
computer, a cell phone with image capturing capability, a video camera with still image 
capturing capability, etc. 

The image capture apparatus 100 comprises a light sensor 102 that, can he a CCD, CMOS 

1 0 or other sensor array that transforms a light image into electronic form. Most cameras are 

equipped with a built-in flash 104, also referred to as a strobe. In many cases, the camera strobe 
is physically close to the lens, which tends to accentuate the occurrence and strength of the red 
eye artifact, hi addition, the camera is equipped with a lens 106. The relevant parameters of the 
lens during acquisition include the aperture 1 14, or a f~stop, which primarily determines the 

1 5 depth of field, the focal length 1 12 which determines the enlargement of the image, and the 
focusing distance 1 16 which determines the distance to the object that the lens 106 was focused 
at. 

Block 130 of Figure 1 represents the red eye filter that performs a process of detection 
and correction of red eye artifacts. The process can be done in the camera as part of the 

20 acquisition stage, in the camera at a post processing stage, during the transferring of the image 
from the camera to an external device such as a personal computer, or on the external device as a 
post processing stage, such as in image transfer software or image editing software. 

The red eye filter includes two main stages. Block 132 represents a meta-data analysis 
module 132, where the image is evaluated based on meta-data and anthropometric data (Fig. 8), 

25 Block 13$ represents a pixel-based analysis of the image data. The pixel-based analysis 1 38 
receives information from the meta-data stage 132. Therefore, the decision on the pixel level 
may vary based on the conditions under which the image was captured and/or other meta-data. 
Block 160 represents an image storage component 160 that saves the image after the red eye 
correction operation. 
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Figure 2 is a workflow representation corresponding to the preferred camera embodiment 
illustrated at Figure L The image capture stage is represented by block 200. This operation 
includes the pre-acqoisition setup 210, where the user and/or the camera determine preferred 
settings such as f-stop 212, flash on/off 214 and/or focal length 216. The image capture stage 
5 200 also includes acquisition or picture taking 226 and temporary storage in block 228 in its final 
form or in a RAW form that corresponds to the image as captured by the light sensor 102 of 
Figure 1 . As part of the capture process, the camera determines the best acquisition parameters 
in the pre~acquisition stage 21 0. Such parameters may include the right exposure, including 
gain, white balance and color transformation, and in particular aperture settings 212 and whether 
10 to use flash 2 1 4. In addition, the user may decide on the focal length 216 of the lens 1 06, which 
is also be referred to as the zoom position. 

The image after being stored in block 228 is then processed for red eye, 230, in 
accordance with a preferred embodiment, among other s tages of processing that may include 
color corrections, compression, sharpening, etc. The red-eye filter 230 is preferably performed 
15 by software in or outside the camera or other image acquisition device. The red eye filter 
preferably includes two main operations - red eye detection 240 and red eye correction 250. 

The red eye detection 240 includes a. first stage of analyzing the meta-data 242, a stage of 
transferring th esu ' t ■ d tta 14 1 a ic rlv specific red eye detection 246 based on pixel, analysis. 
The red eye correction is illustrated at Figure 2 as the operation 250 where any image 
20 modifications based on the results of the detection stage 240 are applied to the image. At this 
stage 250, correction may be binned into the data 252, thus replacing the damaged pixels, saved 
as a list of the pixels that need to be changed with their new value in the header of the image or 
externally 254, and/or presented to the user 256, requesting the user to take an action in order to 
apply the corrections, or a combination of these operations. The image, with the corrections 
25 applied as described in 240, is then preferably saved in block 260. 

Figures 3a-3d illustrates in detail the image as created on the light sensor 102 of Figure 1, 
which is located at the image plane of the optical system. Such sensor can be any electro- 
photosensitive device such as CCD or CMOS. 
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Figure 3a illustrates a grid type CCD. Each one of the smaller squares (as illustrated by 
block 302) is a cell, which is sensitive to light The CCD size 304 is calculated as the diagonal 
of the rectangle made of width 306 and height 308. 

Figure 3b illustrates how a face may be projected onto the CCD. Figure 3c illustrates 
5 how the image is pixeMzed, where the continuous image is transformed into a grid-based Image. 

Figure 3d is more specific to the image as created by a human eye. The image of the eye 
will include the iris 342 as well as the pupil 344, which is usually the locations where red-eye 
artifacts occur. The white part 346 of the eye is also a component of the human eye illustrated at 
Figure 3d and which can be used in red-eye detection, particularly false-detection avoidance, 
i 0 Figure 4 illustrates various meta-data information that can be used as part of a preferred 

embodiment as input, and the potential outcome of such data analysis. For example, blocks 41 2 f 
422 and 432 illustrate an operation of red-eye detection relating to the use or non-use of flash. 
The information whether the flash is used or not, block 412, is forwarded at operation 422 to red- 
eye pre-processing 432 to determine whether there is reason to launch the red-eye filter. If a 
1.5 flash, as determined in 412, is not used, there is preferably no reason to apply the red-eye filter. 
This is a reasonable estimation for consumer lever cameras where most of the red eye is created, 
as described in the introduction, by the small disparity between the strobe unit and the lens. 

Blocks 414, 424, 434 describe the application of raeta-data including the distance to the 
obj ect, the aperture, CCD size, focal length of the lens and the depth of field. This data is usually 
20 recorded on or with the image at acquisition. Based on this information, as transferred to the 

filter at operation 424, the filter can determine at operation 434, e.g.. a range of potential sizes of 
eye regions hi which red-eye can occur, 

Blocks 416, 426, 436 relate to information that is specific to the camera. Hie color 
composition of the image is determined by a few parameters which include the CCD response 
25 curves as illustrated in Figure 9 (see below), the potential color transformations from the 
recorded, RAW image data such as color correction, gain adjustment and white balance to a 
known color space such as RGB or YCC and tone reproduction transformations of the image. 
Such transformations can be presented in. the form of lookup tables, transformation matrices, 
color profiles, etc. 
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Based on the knowledge of the transfer torn operation 426, the software can better 
determine a more precise range of colors at operation 436 that are good candidates for the red 
eye artifacts. This information can advantageously narrow down the potential red eye regions 
based on the variability of sensors and color correction algorithms. It may also help to eliminate 
5 colors that, without this knowledge, could be falsely identified as potential red eye region 

candidates, but are not such in case of a specific combination of sensor and color transformation. 

Figure 5 depicts illustrative information that can be gathered to determine the relative 
size of the object. The ratio of the image size divided by image distance, and the object size 
divided by the object distance, are approximately equal, wherein the image size divided by the 
10 object size is defined as the magnification of the lens 1 06. If one knows three out of the tour 
values, namely focal length 1 12, distance to object : 116, and object size 516, one can estimate the 
size of the image (512): 

O bject size (5 16) _ image size (5 12) 
dista nce to object (116) focal length (1 1 2) 

15 

However, the parameter values described above are usually not known precisely. Instead, 
distributions of values can be estimated. 

Figure 6 illustrates the variability generated by the depth of field. Depth of field is defined as 
the range of distances from the camera to the oi cts w i ! • ■ •■ c c iptured 

20 sufficiently sharp. For a fixed length lens, tire depth of field is a function of the aperture. The more- 
open the aperture is. the shallower die depth of field is. 

As can be seen in Figure 6, due to the fact that the depth of field can be rather large, the 
distance to the objects still in focus can vary. Therefore the parameter 

25 Dis tan ce to Subject 

is rather a range; 

Dis tan ce to „ Subject c/(Ug _ ^ £ Subject 5 Bis tan ce_fo_ Subject m mi& 
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The reason why this information is important and has to be t aken Into consideration is 
depicted in Figure 6. In this case, two objects, a tree 614 and a house 624 are- located in close 
distance 616, aid further away 626 respectively. Even though the tree, 614 and the house 634 are 
5 the same size, the sizes of the objects or the projections of the objects on the image plane are 

different and the tree image. 636 being closer to tire camera appears much larger than the house 646, 

Figure 7 includes some relevant anthropometrical values for male and female averages. 
Figure 7a is an average male and figure 7b is an average adult female. For example, for adult male, 
700, the distance between the eyes, 7 14, is on average 2.36", the distance between, the eyes and the 
.10 nostrils, 724, is 1.5" the width of the head, 71 2 is 6.1"" etc. 

However, this is only the first order approximation. There is a second order approximation, 
which is the overall variability of the values. Such variability once again needs to be calculated into 
the formula. 
Or: 

1 5 Subject Sim $m(l < Subject _ Size < Subject _ S'm Lmt 



The object size, in order to be considered as a candidate for being a face, and eye or any known 
object will be: 



Subject SizeSm aU * Focal Length ^ Qh < Subject „Size, mt * Focal _ Length 
Distmce^To ^Obfect^^ % -^ a -~^ fc s p M an >. o^Objea 



Specifically, as seen in Figure 7c, the average size of an eyebal l 770. is roughly 1", or 
24mm i id the t I s half in diameter to the lull eye, or 0.5" or 12mm in 

diameter. The pupil, 774 can be. as small as a tew millimeters, and dilated to as large as the size of 
25 the iris. Fortunately, in the case of red-ey itti facts. - hich happen primarily in low lighting 
conditions that requi I i hi pupil will be on the dilated side. 

The variability in this case is not only for different individuals, but also vari ability based on 
age. Luckily, in the case of eyes, the size of the eye is relatively constant as tire person grows from a 
baby into an adult* tins is the reason of the stalking effect of "big eyes" that is seen in babi es and 
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young children. The average Mart's eyeball measures approximately 19 1 A millimeters from front to 
back, and as described above, grows to 24 millimeters on avemge during the person's lifetime. 
Based on this data, in case of eye de 1 size of the object which is the pupil which is part of 

the Ms, is limited, when allowing some variability to be: 

5 

9 mm < Size Of Iris < 1 3mm 

The object size as calculated above is going to be in actual physical size such as millimeters 
or inches. For this invention to become useful, this information needs to be presented measured in 
10 pixel sizes. 

Returning to Figure 3 a, the size of the sensor is depicted by 304 which is the diagonal of die 
sensor. Based on that and the ratio between the width, 306 and the height, 308, the width and 
height can be calculated as a Pythagorean triangle. 



1 5 Sensor^ Diagonal „ Size ~ -/ width 2 + Height* 

Knowing the sensor resol ution, the size of object can now be translated into pixel size. 

For example, given a % inch (1.2mm) CCD with an aspect ratio of 2:3 and a 2,000 x 3,000 CCD 

resolution, die width of the CCD is: 

20 

12mm - 7(2or) 2 +(3a) J - Jlia 

3a ** 3x12/ VB * 3x3.3 * 10mm 

and therefore, for a 3000 pixel width, a 1mm object size is equal to roughly 300 pixels. 
Or 

25 

Image ^Size* ^ = Image ^Size^^ 
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Based, on Has formula, when an image of aa object is detected , the image size in pixels is 
compared to the range allowed for an object of the kind sought for, arid accordingly a decision is 
made as to whether the image is that of the sought object or not. Thus, for example, using meta- 
data and anthropometric data as well as image data, as exemplified by Mocks 414, 424 and 434 of 
5 Figure 4, a human eye can be identified with a fair degree of certainty, and certainly with more 
certainty than a solely image-based analysis as performed by DeLuca, 

An example is depicted in Figure 3d where a h>potheticai eye is displayed in pixels, and in 
tins ease the iris 342 is roughly i I pixels hi diameter and the pupil 344 is roughly 6 pixels in 
diameter. With the added knowledge of the distance to the object and the focal length of the lens, 
1 0 the above calculations, performed in software, provide a decision process capable of rejecting 
objects that are not eyes and selecting most likely candidates to be an. eye based on the sizes of the 
captured images of the obj ects. 

Figure 8 is a software workflow diagram describing a statistical analysis of an image using 
meta-data and anthropometric data in accordance with a preferred embodiment The input is the 
15 meta-data 414, as described in Figure 4, and human anthrop lei K edin Figures 

7a and 7b. 

In step 810 the size distribution of the objects of interest, in the present case human eyes, is 
calculated as a function of the data 414 and 800, This calculation is described above and yields a 
probable range of object sizes which, for the given meta-data and anthropometric data, could be 
20 human eyes (irises and/or pupils). Note that this calculation can be done on the fly or alternatively 
pre-calculated values can be stored hi a database to speed up the processing. 

When looking for eyes in an image, given regions suspected as eyes 820, as determined by 
prior ait methods which examine only tire image (pixel) data, step 830 checks whether each region 
falls within die range of sizes calculated above in step 810. If the region size is too large or too 
25 small, i.e. it falls outside die probable range, step 860 decreases a probability index that the region is 
an eye. On the < s and, i the region size is within the range, stej 50 increase ihe probability 
index. It will be understood, however, that these decisions are probabilistic n suits and not 
necessarily conclusive. 

Thispteferrc I 1 

30 decision by looking for additional elites such as the existence of a second eye 832, searching for 
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surrounding facial features 834 such, as the overall shape of the fece, the hair, neck etc., searching 
for the existence of Hps in proximity to the eyes 836, searching for nostrils 838. etc. 

in each step, the question asked is whether the searched feature was found, step 840. If the 
reply is positive, then the probability index for the region being an eye is raised, 850, and if 
5 negative, the probability index is reduced, 860. Of course, this pro'f sabili tic approach can be useful 
to create a better set of criteria in deciding whether the detected object is what the system is looking 
for. In more detail, the detection process involves two types of allowed errors also known as Type-I 
and Type-XI errors, or also referred to as a-eiror, which is the acceptable probability of making a 
wrong decision, or a false positive and {i-error, which is the acceptable probability of not detecting 

1 0 at all. Based on Ms approach, the probability index as decreased or increased hi steps 8S0 and 860 
are always compared against the two criteria a and j>. 

Finally, when al! tests are complete for a given region, if the probability index is above some 
predetermined threshold, which may be empirically derived for a particular make or type of digital 
image acquisition device, foe object is taken to be air eye. 

1 5 Now, foe image data is subj ect to pixel analysis 246. Figure 2. In this, foe pixels in those 

regions which are taken to be eyes, and more particularly the pupil and/or iris, are examined to see 
whether (heir colour corresponds to red-eye. Techniques for testing pixels for a particular colour, or 
range of colors, indicative of red-eye are well known, as described for example in DeLuca, 
However, by using the device-specific meta-data 416, Figure 4, the range of colours indicative of 

20 red eye in an image can be more accurately determined than in the prior art. , 

This is illustrated in Figure 9 whose graph describes the relative response 900 as a ftmction 
of the visual wavelength 910, of the three sensors for blue, 932, Green 934, and Red 936. of a 
typical CCD type sensoi Sii ilar grap! dt 1 • sponse curve describes the 

' it. layers fo? p io ogi iphic film. 

25 The x-axis, which is the wavelength range of the human visual system, is expanded to 

include infrared and til Ira violet, which may not be visible to the human eye but may record on a 
sensor. The y-axis is depicted in relative value as opposed to an absolute one. The three Red, 
Green, and Blue spectral response functions as functions of the wavelength are defined respectively 
as: R{X\G(X),B{X) 
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Given a light source defined as a spectral response curve 1(A), , the light source when 
reaching the three different color sensors, or color pigments on film, will generate a response for 
each of the colors as defined mathematically as the integral of the scalar multiplication of the 
curves. The range of integration is from the low wavelength region UV to the highest IR. 

5 

&-m *-f 
R « JX x L,dX , G - \G X x L,dA B m \B X x l x dX 
i-uv i~w 

to create a tristimulus value of [R,G, S) 

Those skilled in the art are familiar with the fact that different spectral responses may create 
1 0 the same tristimulus values due to the scalar reduction from a 2 dimensional representation to a 
single value. This effect is also known as Metamerism which can be a property of the 
sensor's/film's metamerizm, the human visual system metamerism, or the light source's 
metamerizm. 

Due to the many variable parameters, it is relatively hard to find a specific color that cm be 
1 5 a fixed-reference-point in an image. The reason is that the reflected colors are usually dependent on 
many factors and especially on the ambient light. However, Red Bye artifacts, as previously 
explained, are results of the reflection of the strobe light, which has very well defined 
characteristics, from the vascular membrane behind die retina, which is rich in blood vessels. In 
most cases, fee effect of the external ambient light is relatively low, and the red-eye effect can be 
20 considered as a self-illuminating object, with more precise spectral characteristics than other 
objects. An example of such spectral response, which is a combination, of the flash spectral 
response, which is relatively broad and the blood vessels inside the eye, is depicted in block 950. 

Given the spectral sensiti vity of the sensor R(A% G(A) y B(A) and the reflection of the flash 
light in the eye, as defined by 950, E(A) > the red eye tristimulus values for this specific sensor are; 

25 

{R>G t BU_ e3:s ^f{R,G,B}t*L A dA 
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This value of (i?,<3, 5} w „ „ „ is relatively constant for a given camera. However, due to 
the difference in the response between different sensors, these values are not constant across 
different cameras. However, with the knowledge of the response curves above, one can 
determine a much closer approximation of the range or red colors based on this information. 
5 Note that it is not only the value of the Red that may help in such determination* but also the 
residual response of die red eye on the Green and even less the blue sensor. One skilled in the 
art knows that most cameras perioral additional transformations for exposure and tone 
reproduction for images before saving them into persistent storage. An example of such 
transformation will be a concatenation of color correction and tone reproduction as a function of 
10 the pixel value: 

Given a Raw pixel value of: 

1 5 as transformed via three lookup tables. For example for red lookup table : 

R ~ LUT(Raw - Fix) : {input _ values} ~> {output values) 

for example the Red lookup table R-Lut can be a gamma function from 10 bit raw data to 
20 8 bits as follows: 

R lltT (Maw-.Pix) : {0..1024} -> {Q..256} 

25 

and the inverse function 

iTV(x) - {R LmjtAW mofa *1024 
30 The { R,G,B } values after transformed through the lookup table will be: 
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'RR RG RB 
GR GG GB 
BR BG BE 



{R,G,8} licv ^{R,G ; B) u/i . 



With the bite ia know edge of these transformations, one can reverse the process, to 
5 reach the RAW values as defined abo ve. 



AS i?G RB 
GR GG GB 
BR BG BB 



x{R,G,B} t 



and the value of the raw tristimtuus values can be then determined and used for 
the exact matching. Similar transformations are performed by digital scanners in order to correct 
for sub optimal images such as underexposure, or wrong ambient light, Reversing the process 
may be difficult in its pure mathematical sense e.g. the conversion function may through the 
transformation not be fully reversible. Such issues occur for example when the pixel values are 
clipped or condensed. In such cases, there is a need to define a numerical approximation to the 
Inverse function. 

The prcieo J tnbodi tits les ri bed herein ma ■ involve expat led digi il acquisition 
technology that inherent! \ im oh es digil ca neras, but tln.it ma> be integrated with other devices 
such as cell-phones : xl with an at juisition component, toy cameras eic. The digital 
camera or other image acquisition device of the preferred embodiment has the capability to 
record not only image data, but also additional data referred to as mete-data. Hie file header of 
an image file, such as JPEG, TIFF, JPEG-20G0, etc.. may include capture information such as 
whet! ter a flash was used, the distance as recorded by the auto-fecm mechanism, the focal length 
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of the leas, the sensor resolution, the shutter and the aperture. The preferred embodiments 
described herein serve to improve the detection of red eyes in images, while eliminating or 
reducing the occurrence of false positives, audio improve the correction ol the dete« * i rti tacts 
While an exemplary chawing and specific embodiments of the pre * >n have 

5 been described and illustrated, it is to be understood that that the scope of the present invention is 
not to be limited to the particular embodiments discussed. Thus, the embodiments shall be 
regarded as illustrative rather than restrictive, and it should be understood that variations may be 
made in those embodiments by workers skilled in the arts without departing from the scope of 
the present invention, as set forth in the claims below and structural and functional equivalents 
10 thereof. 

In addition, in methods that may be performed according to preferred embodiments 
herein and that may have been described above, the operations have been described in selected 
typographical sequences. However, the sequences have been selected and so ordered for 
typographical convenience and are not intended to ii ?lj n parfh la >rdc \ i rmhig th 
15 operations, unless expressly set forth or understood by those skilled in the art being necessary. 
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CLAIMS 

3 , A method of filtering a red-eye phenomenon from a digital image, the method 
5 comprising using both anthropometric data and meta-data associated with the image to identify 
regions of the image potentially susceptible to red-eye artifacts. 

2. The method claimed in claim 1 , wherein the image is created by optically 
projecting an external subject onto a sensor array through a lens, and wherein properties of said 

10 regions are identifi ed as a function of one or more of the foeai length of said lens, the aperture of 
said lens, the size of the array, the resolution of said array, the distance to tire subject and the 
depth of field at the moment of acquisition. 

3 . The method claimed in claim 2, wherein each identified region is assigned a 
1 5 probability of being susceptible to red-eye artifacts, and is subject to at least one further 

antkopometric test to increase or decrease the said probability, 

4. The method claimed in claim 3, further comprising examining pixels within each 
identified region having a probability above a certain threshold to determine those pixels having 

20 a colour representative of red-eye artifacts. 

5. The method claimed in claim 4, wherein colours representative of red-eye 

arlii tcts an defin* I as a function of one or more of the spectral respon se of t he sensor army, the 
colour transformations of said image, the tone reproduction transformations of t he image, or a 
25 combination thereof. 



6. The method claimed in any preceding claim, the filtering being executed at least 
P trt ilh v\»hm a portable image acquisition device having no photographic film. 
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7. The method claimed in claim 6, wherein the filtering is executed wholly within 
the portable image acquisition device. 

8 . The method claimed in any one of claims 1 to 5, the filtering being executed at 
5 least partially as a postprocessing operation on an external computation device. 

9. A system of filtering a red-eye phenomenon from a digital image, the system 
comprising means using both anthropometric data and meta-daia associated with the image to 
identify regions of the image po tentially susceptible to red-eye artifacts. 

10 

10. The system claimed in claim 9, wherein the image is created by optically 

proj ecting an external subject onto a sensor army through a lens, and wherein properties of said 
regions are identified as a function of one or more of the focal length of said lens, the aperture of 
said lens,, the size of the array, (fee resolution of said array, the distance to the subject and the 
! 5 depth of field at the momen t of acquisition. 

1 1 . The system claimed in claim 10, further including means for assigning each 
identified region a probability of being susceptible to red-eye artifacts, and means for subjecting 
each identified region to at least one further anthropometric test to increase or decrease the said 

20 probability. 

1 2. The system claimed in claim 1 1 , further comprising means for examining pixels 
within each identified region having a probability above a certain threshold to determine those 
pixels having a colour representati ve of red-eye artifacts. 

25 

13. The system claimed in claim 12, wherein colours representative of red-eye 
arti.fi are lefiaed as a function of one or more of te sp« al response of the sensor array, the 
colour transformations of said image, the tone reproduction transformations of the image, or a. 
vs>; ib r tioi h re . 



30 
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1 4. The system claimed in any one of claims 9 to 13, wherein the system is embodied 
at least partially within a portable image acquisition device having no photographic film. 

15. The system claimed in claim 14, wherein the system is embodied wholly within 
said portable i ti itiott device. 

5 

1 6. The system claimed in claim 14 or 15. wherein said portable image acquisition 
device is a digital camera. 

17. The system claimed in any one of claims 9 to 13, wherein the system is embodied 
1 0 at least partially as a post-processing function on an external computation device. 
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